Training feedforward neural networks with dynamic particle swarm optimisation
نویسندگان
چکیده
منابع مشابه
A Smooth Optimisation Perspective on Training Feedforward Neural Networks
We present a smooth optimisation perspective on training multilayer Feedforward Neural Networks (FNNs) in the supervised learning setting. By characterising the critical point conditions of an FNN based optimisation problem, we identify the conditions to eliminate local optima of the cost function. By studying the Hessian structure of the cost function at the global minima, we develop an approx...
متن کاملTraining feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm
The Gravitational Search Algorithm (GSA) is a novel heuristic optimization method based on the law of gravity and mass interactions. It has been proven that this algorithm has good ability to search for the global optimum, but it suffers from slow searching speed in the last iterations. This work proposes a hybrid of Particle Swarm Optimization (PSO) and GSA to resolve the aforementioned proble...
متن کاملParticle Swarm Optimisation for learning Bayesian Networks
Specifically, we detail two methods which adopt the search and score approach to BN learning. The two algorithms are similar in that they both use PSO as the search algorithm, and the K2 metric to score the resulting network. The difference lies in the way networks are constructed. The CONstruct And Repair (CONAR) algorithm generates structures, validates, and repairs if required, and the REstr...
متن کاملTraining Neural Networks Using Multiobjective Particle Swarm Optimization
This paper suggests an approach to neural network training through the simultaneous optimization of architectures and weights with a Particle Swarm Optimization (PSO)-based multiobjective algorithm. Most evolutionary computation-based training methods formulate the problem in a single objective manner by taking a weighted sum of the objectives from which a single neural network model is generat...
متن کاملComplex-Valued Neural Networks Training: A Particle Swarm Optimization Strategy
QSAR (Quantitative Structure-Activity Relationship) modelling is one of the well developed areas in drug development through computational chemistry. This kind of relationship between molecular structure and change in biological activity is center of focus for QSAR modelling. Machine learning algorithms are important tools for QSAR analysis, as a result, they are integrated into the drug produc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Swarm Intelligence
سال: 2012
ISSN: 1935-3812,1935-3820
DOI: 10.1007/s11721-012-0071-6